Overcoming motor "forgetting" through reinforcement of learned actions.
نویسندگان
چکیده
The human motor system rapidly adapts to systematic perturbations but the adapted behavior seems to be forgotten equally rapidly. The reason for this forgetting is unclear, as is how to overcome it to promote long-term learning. Here we show that adapted behavior can be stabilized by a period of binary feedback about success and failure in the absence of vector error feedback. We examined the time course of decay after adaptation to a visuomotor rotation through a visual error-clamp condition--trials in which subjects received false visual feedback showing perfect directional performance, regardless of the movements they actually made. Exposure to this error-clamp following initial visuomotor adaptation led to a rapid reversion to baseline behavior. In contrast, exposure to binary feedback after initial adaptation turned the adapted state into a new baseline, to which subjects reverted after transient exposure to another visuomotor rotation. When both binary feedback and vector error were present, some subjects exhibited rapid decay to the original baseline, while others persisted in the new baseline. We propose that learning can be decomposed into two components--a fast-learning, fast-forgetting adaptation process that is sensitive to vector errors and insensitive to task success, and a second process driven by success that learns more slowly but is less susceptible to forgetting. These two learning systems may be recruited to different degrees across individuals. Understanding this competitive balance and exploiting the long-term retention properties of learning through reinforcement is likely to be essential for successful neuro-rehabilitation.
منابع مشابه
Overcoming catastrophic forgetting with hard attention to the task
Catastrophic forgetting occurs when a neural network loses the information learned in a previous task after training on subsequent tasks. This problem remains a hurdle for artificial intelligence systems with sequential learning capabilities. In this paper, we propose a task-based hard attention mechanism that preserves previous tasks’ information without affecting the current task’s learning. ...
متن کاملContinual and One-Shot Learning Through Neural Networks with Dynamic External Memory
Training neural networks to quickly learn new skills without forgetting previously learned skills is an important open challenge in machine learning. A common problem for adaptive networks that can learn during their lifetime is that the weights encoding a particular task are often overridden when a new task is learned. This paper takes a step in overcoming this limitation by building on the re...
متن کاملContinual Learning through Evolvable Neural Turing Machines
Continual learning, i.e. the ability to sequentially learn tasks without catastrophic forgetting of previously learned ones, is an important open challenge in machine learning. In this paper we take a step in this direction by showing that the recently proposed Evolving Neural Turing Machine (ENTM) approach is able to perform one-shot learning in a reinforcement learning task without catastroph...
متن کاملForgetting in Reinforcement Learning Links Sustained Dopamine Signals to Motivation
It has been suggested that dopamine (DA) represents reward-prediction-error (RPE) defined in reinforcement learning and therefore DA responds to unpredicted but not predicted reward. However, recent studies have found DA response sustained towards predictable reward in tasks involving self-paced behavior, and suggested that this response represents a motivational signal. We have previously show...
متن کاملHow motor practice shapes memory: retrieval but not extra study can cause forgetting.
We investigated the retrieval specificity of retrieval-induced forgetting (RIF) of motor sequences. In two experiments, participants learned sequential finger movements, each consisting of the movement of two fingers of either the left or the right hand. In the learning phase, these motor sequences were graphically presented and were to be learned as responses to simultaneously presented letter...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- The Journal of neuroscience : the official journal of the Society for Neuroscience
دوره 32 42 شماره
صفحات -
تاریخ انتشار 2012